New Technology / Data Centers
Technology signals, innovation themes, and applied engineering trends. Topic: Data-Centers. Updated briefs and structured summaries from curated sources.
The RAM Crisis Keeps Getting Worse
Full timeline
0.0–300.0
The supply shortage of RAM is impacting consumer electronics due to increased demand from AI data centers. OpenAI's acquisition of 40% of global high bandwidth RAM is shifting production priorities away from consumer devices.
- The supply shortage of RAM is evident, with consumers facing higher prices and delayed product releases. This situation is driven by the growing demand for RAM in AI data centers, which are critical for modern computing
- OpenAI has secured about 40% of the global high bandwidth RAM, shifting production priorities away from consumer devices. This demand affects a wide range of electronics, including phones and laptops
- High bandwidth memory (HBM) is essential for AI training hardware and shares the same wafer fabrication process as consumer RAM. The allocation of wafers to HBM reduces the availability of consumer-grade RAM, worsening supply issues
- Nvidias CEO met with Samsung memory executives to secure RAM supplies, emphasizing the competitive landscape favoring AI data centers. Samsung now profits more from RAM sales to data centers than from its phone sales, indicating a significant market shift
- As AI demand rises, manufacturers are prioritizing server-grade memory for AI operations. This focus raises concerns about the availability of consumer RAM, as data center needs take precedence
300.0–600.0
A few companies, including Samsung, SK Hynex, and Micron, dominate the global supply of high-quality RAM, controlling 93% of the market. Micron's exit from the consumer RAM sector to focus on enterprise and AI buyers raises concerns about future consumer RAM availability.
- Only a few companies, including Samsung, SK Hynex, and Micron, control 93% of the global supply of high-quality RAM for AI data centers. This concentration creates a fragile system where a single disruption can have widespread effects
- Microns exit from the consumer RAM market to focus on enterprise and AI buyers has significant implications for consumer RAM availability. Predictions indicate that leftover consumer stock may sell out by early 2026
- Tech giants like Google and Microsoft are scrambling to secure RAM allocations, with executives labeled as DRAM beggars in their negotiations with suppliers. Googles attempts to secure high-bandwidth memory for its TPUs faced blunt refusals due to supply constraints
- Memory manufacturers cannot simply increase production to meet rising demand, as their facilities are already operating at full capacity. Adjusting production levels is delicate and can lead to significant delays
- Building new fabrication plants takes at least two years before they can produce chips, posing a risk for companies investing billions based on uncertain future demand. This uncertainty could lead to a bubble in the AI market
- Sam Altman, CEO of OpenAI, has acknowledged the possibility that the current AI frenzy may be a bubble. His comments reflect cautious sentiment among industry leaders regarding the sustainability of demand for AI technologies
600.0–900.0
The current RAM supply crisis is exacerbated by increased demand from AI technologies, leading to significant price increases and supply limitations for consumer electronics. Industry leaders express caution, fearing that the AI boom may be a bubble, which could result in financial losses if demand declines unexpectedly.
- Sam Altman expressed concerns that the current AI boom may be a bubble, suggesting that while AI is significant, investors are overly excited, which could lead to financial losses for some. This sentiment reflects cautious views among industry leaders regarding the sustainability of demand for AI technologies
- The memory industry is hesitant to increase production capacity due to past experiences where a surge in demand led to oversupply and price collapses. Executives are now facing overwhelming requests for memory supplies, with potential risks to business operations if demands are not met
- Japanese electronic retailers have started limiting hard drive purchases, while Apple is paying a 230% premium for memory used in its iPhone 17 Pro models. This indicates severe supply chain pressures affecting consumer electronics
- PC manufacturers like Lenovo and HP are scrambling for memory supplies, with predictions that the RAM shortage could last until 2027. This situation may lead to price increases and potential declines in the PC market
900.0–1200.0
The demand for memory in modern AI models is leading to a significant allocation of global memory supply to data centers, impacting consumer hardware availability. Concerns arise regarding the longevity of these memory chips, which may become outdated within two to four years.
- Modern AI models require enormous amounts of memory, with each rack carrying up to 864 gigabytes. This demand is causing a significant portion of the global memory supply to be allocated to data centers, leaving little for consumer hardware. The data center build-out presents a problem as the chips currently in high demand may become outdated in two to four years
1200.0–1500.0
Brilliant provides a learning platform focused on interactive problem-solving rather than traditional grading. Users can try it for free for 30 days and receive a 20% discount on an annual premium subscription.
- Brilliant offers a unique learning platform that emphasizes understanding through interactive problem-solving. Users can access it for free for 30 days, with a 20% discount on an annual premium subscription for unlimited access